Method for processing three dimensional (3d) video signal and digital broadcast receiver for performing the method

ABSTRACT

A method for processing a 3D video signal and a digital broadcast receiver for performing the processing method are disclosed. A method for receiving a 3D broadcast signal includes receiving signaling information of at least one stream for a 3 Dimension TeleVision (3DTV) service and a two dimensional (2D) video stream, demultiplexing at least one stream for the 3DTV service and the 2D video stream based on the signaling information, decoding at least one demultiplexed stream for the 3DTV service and the demultiplexed 2D video stream, and outputting a 3D video signal by formatting at least one decoded stream for the 3DTV service and the decoded 2D video stream.

TECHNICAL FIELD

The present invention relates to three dimensional (3D) broadcasting,and more particularly to a method for processing a 3D video signal and adigital broadcast receiver for performing the processing method.

BACKGROUND ART

Generally, a three dimensional (3D) image (or a stereoscopic image)provides user's eyes with a stereoscopic effect using the stereoscopicvisual principle. A human being senses depth through a binocularparallax caused by a distance between their eyes spaced apart from eachother by about 65 mm, such that the 3D image enables both right and lefteyes to respectively view their associated planar images, and a humanbrain merges two different images with each other, resulting in a senseof depth and a sense of presence in the 3D image.

For example, the above-mentioned 3D image display method may beclassified into a stereoscopic scheme, a volumetric scheme, aholographic scheme, etc. In addition, a 3D image display device addsdepth information to two dimensional (2D) images or uses left view imageinformation and right view image information, such that a user of the 3Dimage display device can feel a sense of vividness and a sense ofreality in a 3D image.

In addition, a method for allowing the user to view the 3D image may beexemplarily classified into one method for providing the user withpolarization glasses and another method where the user is not providedwith polarization glasses.

A television according to the related art has been designed to displayonly a 2D image. In contrast, many developers and companies haverecently conducted intensive research into a 3D imaging technology foruse in digital broadcasting. However, detailed protocols related to a 3Dbroadcast signal processing technology have not been defined yet, sothat broadcast content providers, broadcast stations, and DTVmanufacturers have been thrown into a great confusion with regard tosuch 3D broadcast signal processing.

DISCLOSURE Technical Problem

Accordingly, the present invention is directed to a method forprocessing a three dimensional (3D) video signal and a digital broadcastreceiver for performing the processing method, that substantiallyobviate one or more problems due to limitations and disadvantages of therelated art.

An object of the present invention is to provide a new protocol capableof processing a 3D broadcast signal.

Another object of the present invention is to provide a method for moreeffectively transmitting signaling information needed for a 3Dimensional TeleVision (3DTV) broadcast service.

A further object of the present invention is to provide a method forimplementing a 3DTV broadcast service regardless of whether or not abroadcast station transmits camera parameter information.

Technical Solution

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amethod for receiving a three dimensional (3D) broadcast signal includesreceiving signaling information of at least one stream for a 3 DimensionTeleVision (3DTV) service and a two dimensional (2D) video stream,demultiplexing at least one stream for the 3DTV service and the 2D videostream based on the signaling information, decoding at least onedemultiplexed stream for the 3DTV service and the demultiplexed 2D videostream, and outputting a 3D video signal by formatting at least onedecoded stream for the 3DTV service and the decoded 2D video stream.

In another aspect of the present invention, provided herein is a methodfor transmitting a three dimensional (3D) broadcast signal includesacquiring multiple video information captured by at least two cameras,formatting a two dimensional (2D) video stream extracted from theacquired multiple video information and signaling information of atleast one stream for a 3 Dimension TeleVision (3DTV) service, encodingthe formatted 2D video stream and the formatted signaling information ofat least one stream for the 3DTV service, and transmitting the encoded2D video stream and the encoded signaling information of at least onestream for the 3DTV service.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

Advantageous Effects

One embodiment of the present invention provides a new protocol capableof processing a 3D broadcast signal.

Another embodiment of the present invention provides a method for moreeffectively transmitting signaling information needed for a 3DTVbroadcast service.

Another embodiment of the present invention provides a method forimplementing a 3DTV broadcast service regardless of whether or not abroadcast station transmits camera parameter information.

DESCRIPTION OF DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention, illustrate embodiments of the inventionand together with the description serve to explain the principle of theinvention.

In the drawings:

FIG. 1 is a structural diagram illustrating a plurality of streams forthe 3DTV service according to one embodiment of the present invention.

FIG. 2 shows a Virtual Channel Table (VCT) according to one embodimentof the present invention.

FIG. 3 shows a service type field including an added value from amongfields of the VCT shown in FIG. 2 according to one embodiment of thepresent invention.

FIG. 4 shows a 3D service location descriptor added to the VCT shown inFIG. 2 according to one embodiment of the present invention.

FIG. 5 shows a Program Map Table (PMT) according to one embodiment ofthe present invention.

FIG. 6 shows a 3D service location descriptor added to the PMT shown inFIG. 5 according to one embodiment of the present invention.

FIG. 7 is a block diagram illustrating constituent elements of a digitalbroadcast receiver for processing a 3D broadcast signal including a 3Dservice location descriptor according to one embodiment of the presentinvention.

FIG. 8 is a flowchart illustrating a method for controlling a digitalbroadcast transmitter and a digital broadcast receiver for providing a3DTV service when a digital broadcast transmitter transmits a cameraparameter according to an embodiment of the present invention.

FIG. 9 is a conceptual diagram illustrating some parts of the digitalbroadcast transmitter operations shown in FIG. 8 according to anembodiment of the present invention.

FIG. 10 is a conceptual diagram illustrating some parts of the digitalbroadcast receiver operations shown in FIG. 8 according to an embodimentof the present invention.

FIG. 11 shows one case having no occlusion data and the other casehaving occlusion data in a process for implementing a screen image of a3DTV service according to one embodiment of the present invention.

FIG. 12 is a flowchart illustrating a method for controlling a digitalbroadcast transmitter and a digital broadcast receiver for providing a3DTV service when the digital broadcast transmitter transmits no cameraparameter according to an embodiment of the present invention.

FIG. 13 is a conceptual diagram illustrating some operations of thedigital broadcast transmitter shown in FIG. 12 according to anembodiment of the present invention.

FIG. 14 is a conceptual diagram illustrating some operations of thedigital broadcast receiver shown in FIG. 12 according to an embodimentof the present invention.

FIG. 15 is a conceptual diagram illustrating a method for acquiring anadditional viewpoint image needed for a 3DTV service using an assumptionof viewing geometry when the digital broadcast transmitter transmits nocamera parameter.

BEST MODE

Reference will now be made in detail to the preferred embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings. The detailed description, which will be given below withreference to the accompanying drawings, is intended to explain exemplaryembodiments of the present invention, rather than to show the onlyembodiments that can be implemented according to the present invention.

Prior to describing the present invention, it should be noted that mostterms disclosed in the present invention are defined in consideration offunctions of the present invention and correspond to general terms wellknown in the art, and can be differently determined according tointention of those skilled in the art, usual practices, or introductionof new technologies. In some cases, a few terms have been selected bythe applicant as necessary and will hereinafter be disclosed in thefollowing description of the present invention. Therefore, it ispreferable that the terms defined by the applicant be understood on thebasis of their meanings in the present invention. In accordance with thefollowing embodiments of the present invention, information capable ofprocessing a 3D video signal is contained in system information. Thesystem information may also be called service information. For example,the system information includes channel information, programinformation, event information, etc. In accordance with the embodimentsof the present invention, the system information may be newly added to aProgram Specific Information/Program and System Information Protocol(PSI/PSIP) as necessary. However, the scope and spirit of the presentinvention are not limited to the above-mentioned examples. If it isassumed that there is a protocol capable of transmitting the systeminformation in table format, the scope and spirit of the presentinvention can also be applied to other examples irrespective of titlesof the system information.

The PSI is disclosed only for illustrative purposes and betterunderstanding of the present invention. The PSI may include a ProgramAssociation Table (PAT), a Conditional Access Table (CAT), a Program MapTable (PMT), a Network Information Table (NIT), etc.

The PAT corresponds to specific information which is transmitted by apacket having a PID of ‘0’. The PAT transmits PID information of the PMTand PID information of the NIT of each program. The CAT transmitsinformation of a pay broadcast service used in the broadcasttransmission system. The PMT transmits a program identification number,packet identifier (PID) information of a transport stream packet, inwhich individual bit streams of video and audio data constituting aprogram are transmitted, and PID information, in which a PCR (ProgramClock Reference) is transmitted. The NIT transmits information of anactual transmission network. For example, PID information of a programnumber and the PMT may be acquired by parsing the PAT having a PID of‘0’. In addition, in the case where the PMT acquired from the PAT isparsed, information about correlation among constituent elements of aprogram is acquired.

The PSIP may include, for example, a Virtual Channel Table (VCT), aSystem Time Table (STT), a Rating Region Table (RRT), an Extended TextTable (ETT), a Direct Channel Change Table (DCCT), a Direct ChannelChange Selection Code Table (DCCSCT), an Event Information Table (EIT),a Master Guide Table (MGT), and the like.

The VCT transmits information about a virtual channel, for example,channel information for selecting a channel and information about apacket identifier (PID) for receiving audio and/or video data. That is,when the VCT is parsed, a channel name, a channel number, and the PID ofthe audio and video data of a broadcast program carried in the channelcan be known. The SIT transmits current date and time information, andthe RRT transmits information about a region and an organ ofconsultation for a program rating level. The ETT transmits an additionaldescription about a channel and a broadcast program, and the EITtransmits information about an event of a virtual channel. TheDCCT/DCCSCT transmits information about an automatic channel change, andthe MGT transmits version- and PID-information of individual tablescontained in the PSIP.

The related art has provided only the 2 Dimension (2D) broadcast servicesuch that it has not defined detailed signaling information needed forimplementing the 3DTV service.

Therefore, one embodiment of the present invention provides signalinginformation needed for the 3DTV service, defines a procedure fortransmitting, receiving, and processing the defined information, and adetailed description thereof will hereinafter be described in detail.

FIG. 1 is a structural diagram illustrating a plurality of streams forthe 3DTV service according to one embodiment of the present invention.As shown in FIG. 1, in order to provide the 3DTV service, a 2D videostream, a depth stream, an occlusion stream, a transparency stream, etc.may be needed. However, the occlusion stream, the transparency stream,etc. may be optionally used. A method for defining signaling informationfor the above-mentioned streams will hereinafter be described withreference to the drawings from FIG. 2.

FIG. 2 shows a Virtual Channel Table (VCT) according to one embodimentof the present invention. FIG. 3 shows a service type field including anadded value from among fields of the VCT shown in FIG. 2 according toone embodiment of the present invention.

A brief description of fields shown in FIG. 2 is as follows.

A value of a ‘table_id’ field indicates the type of a table sectionbeing defined here. For a ‘terrestrial_virtual_channel_table_section( )’field, the ‘table_id’ field shall be set to ‘0xC8’.

A ‘section_syntax_indicator’ field is a one-bit field which shall be setto ‘1’ for the ‘terrestrial_virtual_channel_table_section( )’ field.

A ‘private_indicator’ field shall be set to

A ‘section_length’ field is a 12-bit field in which the first two bitsshall be set to ‘00’. It specifies the number of bytes of the section,starting immediately following the ‘section_length’ field, and includingthe CRC. The value in this field shall not exceed ‘1021’.

A ‘transport_stream_id’ field indicates the 16-bit MPEG-2 TransportStream (TS) ID, as it appears in the Program Association Table (PAT)identified by a PID value of zero for this multiplex. The‘transport_stream_id’ field distinguishes a Terrestrial Virtual ChannelTable (TVCT) from others that may be broadcast in different PTCs(Physical Transmission Channels).

A ‘version_number’ field is a version number of the Virtual ChannelTable (VCT). For the current VCT (current_next_indicator=‘1’), theversion number shall be incremented by 1 whenever the definition of thecurrent VCT changes. Upon reaching the value of 31, it wraps around tozero ‘0’. For the next VCT (current_next_indicator=‘0’), the versionnumber shall be one unit more than that of the current VCT (also inmodulo 32 arithmetic). In any case, the value of the ‘version_number’field shall be identical to that of the corresponding entries in aMaster Guide Table (MGT).

A ‘current_next_indicator’ field is a one-bit indicator. In the casewhere the ‘current_next_indicator’ field is set to ‘1’, this means thata transmitted Virtual Channel Table (VCT) is currently applicable. Whena bit of the ‘current_next_indicator’ field is set to ‘0’, this meansthat the transmitted table is not yet applicable and shall be the nexttable to become valid. This standard imposes no requirement that ‘next’tables (those with the ‘current_next_indicator’ field set to ‘0’) mustbe sent. An update to the currently applicable table shall be signaledby incrementing the ‘version_number’ field.

A ‘section_number’ field gives the number of this section. The‘section_number’ field of the first section in the Terrestrial VirtualChannel Table (TVCT) shall be set to ‘0x00’. It shall be incremented byone with each additional section in the Terrestrial Virtual ChannelTable (TCVT).

A ‘last_section_number’ field specifies the number of the last section(that is, the section with the highest section_number value) of thecomplete Terrestrial Virtual Channel Table.

A ‘protocol_version’ field is used to allow, in the future, the tabletype to carry parameters that may be structured differently than thosedefined in the current protocol. At present, only one value valid forthe ‘protocol_version’ field is zero. Non-zero values of the‘protocol_version’ field may be used by a future version of thisstandard to indicate structurally different tables.

A ‘num_channels_in_section’ field specifies the number of virtualchannels in this VCT section. The number is limited by thesection_length.

A ‘short_name’ field specifies the name of the virtual channel.

A ‘major_channel_number’ field indicates a 10-bit number that representsthe ‘major’ channel number associated with the virtual channel beingdefined in this iteration of the ‘for’ loop. Each virtual channel shallbe associated with a major channel number and a minor channel number.Not only the major channel number but also the minor channel number actsas a user's reference number for the virtual channel. The‘major_channel_number’ field shall be present between ‘1’ and ‘99’. Thevalue of ‘major_channel_number’ field shall be set such that there is nocase in which a ‘major_channel_number/minor_channel_number’ pair isduplicated within the TVCT.

A ‘minor_channel_number’ field indicates a 10-bit number in the rangefrom ‘0’ to ‘999’ so as to represent the ‘minor’ or ‘sub’ channelnumber. This ‘minor_channel_number’ field together with the‘major_channel_number’ field may indicate a two-part channel number,where the ‘minor_channel_number’ field represents the second orright-hand part of the number. When the ‘service_type’ field is used toindicate an analog television, the ‘minor_channel_number’ field shall beset to zero ‘0’. Each service, a ‘service_type’ field, a value of whichis either ‘ATSC_digital_television’ or ‘ATSC_audio_only’, shall use anyof minor numbers ranging from 1 to 99. The value of the‘minor_channel_number’ field shall be set such that there is no case inwhich a ‘major_channel_number/minor_channel_number’ pair is duplicatedwithin the TVCT. For other types of services, such as data broadcasting,valid minor virtual channel numbers are in the range from ‘1’ to ‘999’.

A ‘modulation_mode’ field indicates a modulation mode for thetransmitted carrier associated with the virtual channel.

A ‘carrier_frequency’ field is set to a value of zero. The‘carrier_frequency’ field may be used to identify a carrier_frequency,but the use of the ‘carrier_frequency’ field is deprecated.

A ‘channel_TSID’ field in the range from 0x0000 to 0xFFFF represents anMPEG-2 Transport Stream (TS) ID associated with the Transport Stream(TS) carrying the MPEG-2 program referenced by the virtual channel. Forinactive channels, the ‘channel_TSID’ field shall represent an ID of theTransport Stream (TS) that will carry the service when it becomesactive. It is expected that the receiver uses the ‘channel_TSID’ fieldto verify that any received Transport Stream (TS) is actually equal tothe desired multiplex. For analog channels (service_type 0x01), the‘channel_TSID’ field shall indicate a value of the analog TSID includedin a VBI of an NTSC signal.

A ‘program_number’ field may associate the virtual channel being definedhere with the MPEG-2 program association and TS program map tables.

For virtual channels representing analog services, a value of 0xFFFFshall be specified for a ‘program_number’ field.

An ‘ETM_location’ field specifies the existence and the location of anExtended Text Message (ETM).

An ‘access_controlled’ field indicates a 1-bit Boolean flag. When theBoolean flag of the ‘access_controlled’ field is set, this means thataccessing the events associated with a virtual channel may becontrolled. When the Boolean flag is set to ‘0’, event access is notrestricted.

A ‘hidden’ field indicates a 1-bit Boolean flag. When the Boolean flagof the ‘hidden’ field is set, this means that the virtual channel is notaccessed by a user by a direct entry of the virtual channel number.Hidden virtual channels are skipped when the user is channel-surfing,and appear as if undefined, if accessed by direct channel entry. Typicalapplications for hidden channels are test signals and NVOD services.Whether a hidden channel and its events may appear in EPG displaysdepends on the state of the ‘hide_guide’ bit.

A ‘hide_guide’ field indicates a Boolean flag. When the Boolean flag ofthe hide_guide’ field is set to zero ‘0’ for a hidden channel, thismeans that the virtual channel and its events may appear in EPGdisplays. This bit shall be ignored for channels which do not have thehidden bit set, so that non-hidden channels and their events may alwaysbe included in EPG displays regardless of the state of the ‘hide_guide’bit. Typical applications for hidden channels with the ‘hide_guide’ bitset to ‘1’ are test signals and services accessible throughapplication-level pointers.

A ‘service_type’ field shall identify the type of service carried in thevirtual channel. Specifically, as shown in FIG. 3, if the ‘service_type’field is set to 0x10, this means that a virtual channel carries 3Dtelevision programming. Needless to say, the above-mentioned value of0x10 is disclosed only for illustrative purposes, and it is obvious tothose skilled in the art that the scope and spirit of the presentinvention are not limited only to the above-mentioned value but areapplicable to other examples as necessary.

A ‘source_id_field’ identifies the programming source associated withthe virtual channel. In this context, a source is one specific source ofvideo, text, data, or audio programming. A source ID value of zero isreserved. Source ID values in the range from 0x0001 to 0x0FFF shall beunique within the Transport Stream (TS) that carries the VCT, whilevalues 0x1000 to 0xFFFF shall be unique at the regional level. Valuesfor source ids 0x1000 and above shall be issued and administered by aRegistration Authority (RA) designated by the ATSC.

A ‘CRC_(—)32’ field contains a CRC value that ensures a zero output fromthe registers in the decoder.

Moreover, if the ‘service_type’ field has a value corresponding to the3DTV service, the descriptor shown in FIG. 2 may newly define depthinformation, occlusion information, and transparency information neededfor constructing the 3DTV service. A detailed description of the depthinformation, the occlusion information, and the transparency informationwill hereinafter be described with reference to FIG. 4.

FIG. 4 shows a 3D service location descriptor added to the VCT shown inFIG. 2 according to one embodiment of the present invention. Thedescriptor shown in FIG. 4 is present in the VCT shown in FIG. 2, andperforms signaling of information of 3D components constructing acorresponding virtual channel. Detailed descriptions of individualfields are as follows.

A ‘PCR_PID’ field is a 13-bit field indicating the PID of TransportStream (TS) packets which shall contain a PCR field valid for a programspecified by a ‘program_number’ field.

A ‘number_elements’ field indicates the number of elements correspondingto the VCT. For example, the aforementioned elements may indicateelements for 3DTV services.

A ‘data_type’ field indicates whether the above-mentioned elements areassociated with depth data, occlusion data, or transparency data.

An ‘elementary_PID’ field is a 13-bit field specifying the PID ofTransport Stream (TS) packets which carry an associated program element.

A ‘codec_type’ field identifies the encoding type of the above-mentionedelements. For example, the encoding type may be the MPEG-2 video, theH.264/Advanced Video Coding (AVC) video, or the like.

In accordance with the ‘bit_depth_minus_(—)1’ field, if the value of 1is added to the ‘bit_depth_minus_(—)1’ field, this added result meansthe number of bits used for representing each pixel. For example, thenumber of bits may be set to 8, 10, or the like, so that the bits may be8-bits, 10-bits, or the like.

A ‘same_resolution_flag’ field indicates whether or not the resolutionof each element associated with the 3DTV service is identical to theresolution of the 2D video. If the resolution of each element associatedwith the 3DTV service is different from the resolution of the 2D video,the ‘same_resolution_flag’ field indicates a horizontal size and avertical size of the resolution using the ‘horizontal_size’ field andthe ‘vertical_size’ field.

The above-mentioned embodiment of the present invention will hereinafterbe described in detail.

The digital broadcast receiver according to one embodiment of thepresent invention receives not only signaling information of one or morestreams for the 3DTV service but also a 2D video stream. Based on thesignaling information, the digital broadcast receiver may demultiplexone or more streams for the 3DTV service and the 2D video stream.

The digital broadcast receiver decodes at least one demultiplexed streamfor the 3DTV service and the demultiplexed 2D video stream,respectively. The digital broadcast receiver formats at least onedecoded stream for the 3DTV service and the decoded 2D video stream,such that it outputs 3D video data.

As described above, for example, the signaling information may bedefined in a descriptor of the VCT shown in FIG. 2, and the descriptormay be a syntax shown in FIG. 4. In accordance with another embodimentof the present invention, for example, the signaling information may bedefined in the descriptor of the PMT shown in FIG. 5 to be describedlater, and the descriptor may be a syntax shown in FIG. 6 to bedescribed later.

The signaling information may include a first field (e.g., the‘data_type’ field of FIG. 4) for identifying at least one of depthinformation, occlusion information, and transparency information and asecond field (e.g., the ‘codec_type’ field of FIG. 4) for identifying acoding type of the depth information, the occlusion information, or thetransparency information.

The signaling information may further include a third field (e.g., the‘same resolution flag’ field shown in FIG. 4) for identifying whetherthe resolution size of at least one stream for the 3DTV service is equalto that of the 2D video stream.

A detailed description of the above-mentioned embodiment of the presentinvention is as follows.

The broadcast receiver determines whether the 3DTV service is providedover a corresponding virtual channel using the ‘service_type’ fieldcontained in the VCT shown in FIG. 2. If the 3DTV service is providedover the corresponding virtual channel, the broadcast receiver detectselementary_PID information of the 2D video stream using the servicelocation descriptor. The PID of the 2D video stream may be called‘PID_V’.

The broadcast receiver determines which one of depth information,occlusion information, and transparency information is associated with acorresponding elementary stream using the 3D service location descriptor(‘3D_service_location_descriptor’ field) shown in FIG. 4. Subsequently,the broadcast receiver acquires elementary_PID for the correspondingelementary stream. The PID of the depth-associated stream may be called‘PID_D’, the PID of the occlusion-associated stream may be called‘PID_O’, and the PID of the transparency-associated stream may be called‘PID_T’. Needless to say, the above three streams may be partially orfully received at the broadcast receiver. Availability informationindicating which one of streams is available may be determined using the‘data_type’ field.

The broadcast receiver determines coding information and bit informationusing the ‘codec_type’ field and the ‘bit_depth_minus_(—)1’ fieldcontained in the 3D service location descriptor (the‘3D_service_location_descriptor’ field) shown in FIG. 4.

The broadcast receiver transmits a stream corresponding to PID_V to avideo decoder by demultiplexing the received streams, and the videodecoder decodes the received streams.

The broadcast receiver transmits streams corresponding to PID_D, PID_O,and PID_T to a first decoder for processing depth information, a seconddecoder for processing occlusion information, and a third decoder forprocessing transparency information, respectively. The first decoder,the second decoder, and the third decoder may be integrated into one 3Dmetadata decoder such that each or all of the decoders may be called the3D metadata decoder.

Finally, the broadcast receiver simultaneously processes the 2D videostream and at least one stream (e.g., depth, occlusion, transparency,and the like) for the 3DTV service corresponding to the 2D video stream,so that it may make a rendering or format 3D video data.

FIG. 5 shows a Program Map Table (PMT) according to one embodiment ofthe present invention.

A brief description of fields shown in FIG. 5 is as follows.

A ‘table_id’ field is an 8-bit field which shall always be set to ‘0x02’in a ‘TS_program_map_section’ field.

A ‘section_syntax_indicator’ field is a 1-bit field which shall be setto ‘1’.

A ‘section_length’ field is a 12-bit field in which first two bits shallbe set to ‘00’. The remaining 10 bits may specify the number of bytes ofthe section starting immediately following the ‘section_length’ field,and including the CRC. The value in this field shall not exceed ‘1021’(0x3FD).

A ‘program_number’ field is a 16-bit field. It specifies the program towhich the ‘program_map_PID’ field is applicable. One program definitionshall be carried within only one ‘TS_program_map_section’ field. Thisimplies that a program definition is never longer than ‘1016’ (0x3F8).For example, the ‘program_number’ field may be used as a designation fora broadcast channel. By describing the different program elementsbelonging to a program, data from different sources (e.g. sequentialevents) can be concatenated together to form a continuous set of streamsusing a ‘program_number’ field.

A ‘version_number’ field is the version number of the‘TS_program_map_section’ field. The version number shall be incrementedby 1 modulo 32 when a change in the information carried within thesection occurs. The version number refers to the definition of a singleprogram, and therefore to a single section. When the‘current_next_indicator’ field is set to ‘1’, then the ‘version_number’field shall be that of the currently applicable ‘TS_program_map_section’field. When the ‘current_next_indicator’ field is set to ‘0’, then the‘version_number’ field shall be that of the next applicable‘TS_program_map_section’ field.

A ‘current_next_indicator’ field may be set to ‘1’, which indicates thatthe transmitted ‘TS_program_map_section’ field is currently applicable.When a bit of the ‘current_next_indicator’ field is set to ‘0’, the bitof ‘0’ indicates that the transmitted ‘TS_program_map_section’ field isnot yet applicable and shall be the next ‘TS_program_map_section’ fieldto become valid.

The value of the ‘section_number’ field shall be ‘0x00’.

The value of the ‘last_section_number’ field shall be ‘0x00’.

A ‘PCR_PID’ field is a 13-bit field indicating the PID of the TransportStream (TS) packets which shall contain the PCR fields valid for theprogram specified by a ‘program_number’ field. In the case where no PCRis associated with a program definition for private streams, then thisfield shall take the value of ‘0x1FFF’.

A ‘program_info_length’ field is a 12-bit field, the first two bits ofwhich shall be ‘00’. The remaining 10 bits may specify the number ofbytes of descriptors immediately following the ‘program_info_length’field.

A ‘stream_type’ field is an 8-bit field specifying the type of a programelement carried within packets with the PID whose value is specified bythe ‘elementary_PID’ field.

An ‘elementary_PID’ field is a 13-bit field specifying a PID of theTransport Stream (TS) packets which carry the associated programelement.

An ‘ES_info_length’ field is a 12-bit field, the first two bits of whichshall be ‘00’. The remaining 10 bits may specify the number of bytes ofdescriptors of the associated program element immediately following the‘ES_info_length’ field.

A ‘CRC_(—)32’ field is a 32-bit field which contains a CRC value thatgives a zero output of registers in the decoder.

In addition, the ‘stream_type’ field of the PMT shown in FIG. 5 may beused for the same purpose as that of the ‘data_type’ field shown in FIG.4. The descriptor shown in FIG. 5 may be located under the‘ES_info_length’ field, and include information of the elementary streamfor the 3DTV service. The descriptor shown in FIG. 5 may be designed inthe form of the 3D service location descriptor shown in FIG. 6, andfunctions of fields shown in FIG. 6 may be identical to those of fieldsshown in FIG. 4. Accordingly, in accordance with the present invention,it is possible to insert the signaling information for the 3DTV serviceinto each of the VCT and the PMT. FIG. 6 shows a 3D service locationdescriptor added to the PMT shown in FIG. 5 according to one embodimentof the present invention.

Another embodiment of the present invention will hereinafter bedescribed in detail.

The broadcast receiver determines which one of depth information,occlusion information, and transparency information is associated with acorresponding element stream using the ‘stream_type’ field of the PMTshown in FIG. 5. Subsequently, the broadcast receiver acquireselementary_PID for the corresponding elementary stream. The PID of thedepth-associated stream may be called ‘PID_D’, the PID of theocclusion-associated stream may be called ‘PID_O’, and the PID of thetransparency-associated stream may be called ‘PID_T’. Needless to say,the above three streams may be partially or fully received at thebroadcast receiver. Availability information indicating which one ofstreams is available may be determined using the ‘stream_type’ field.

The broadcast receiver determines coding information and bit informationusing the ‘codec_type’ field and the ‘bit_depth_minus_(—)1’ fieldcontained in the 3D service location descriptor (the‘3D_service_location_descriptor’ field) shown in FIG. 6.

The broadcast receiver maps received information to information providedfrom the VCT using the program number (‘program_number’) field shown inFIG. 5. As a result, the broadcast receiver determines which one ofvirtual channels is provided for a 3DTV service.

The broadcast receiver transmits a stream corresponding to PID_V (i.e.,PID corresponding to the 2D video stream) to a video decoder bydemultiplexing the received streams, and the video decoder decodes thereceived streams.

The broadcast receiver transmits streams corresponding to PID_D, PID_O,and PID_T to a first decoder for processing depth information, a seconddecoder for processing occlusion information, and a third decoder forprocessing transparency information, respectively. The first decoder,the second decoder, and the third decoder may be integrated into one 3Dmetadata decoder such that each or all of the decoders may be calledonly the 3D metadata decoder.

Finally, the broadcast receiver simultaneously processes the 2D videostream and at least one stream (e.g., depth, occlusion, transparency,and the like) for the 3DTV service corresponding to the 2D video stream,so that it may make a rendering or format 3D video data.

FIG. 7 is a block diagram illustrating constituent elements of a digitalbroadcast receiver for processing a 3D broadcast signal including a 3Dservice location descriptor according to one embodiment of the presentinvention.

Referring to FIG. 7, the digital broadcast receiver 700 according to oneembodiment of the present invention includes a tuner & demodulator 710,a Vestigial Side Band (VSB) decoder 720, a TP demultiplexer 730, aPSI/PSIP/SI processor 740, a 3D video decoder 750, an output formatter760, and the like. The TP demultiplexer (TP Demux) 730 may also befunctioned as a PID filter, and the 3D video decoder may include aprimary video decoder 750 and a 3D metadata decoder 752.

The tuner & demodulator 710 may receive a digital broadcast signal fromthe digital broadcast transmitter, and demodulate the received broadcastsignal. For example, the digital broadcast signal may include signalinginformation of at least one stream for the 3DTV service, a 2D videostream, and the like.

The VSB decoder 720 decodes the demodulated signal. The TP demultiplexer730 transmits a 2D video stream to the primary video decoder 751,transmits one or more streams for the 3DTV service to the 3D metadatadecoder 752, and transmits signaling information of one or more streamsfor the 3DTV service to the PSI/PSIP/SI processor 740 by using PID.

The primary video decoder 751 may decode the demultiplexed 2D videostream. The 3D metadata decoder 752 receives signaling information forthe 3D service shown in FIG. 4 or 6 from the PSI/PSIP/SI processor 740,and decodes at least one demultiplexed stream (e.g., a depth stream, anocclusion stream, a transparency stream, a DOT stream, etc.) for the3DTV service.

The output formatter 760 formats at least one decoded stream for the3DTV service and the decoded 2D video stream, such that it outputs 3Dvideo data. For example, the 3D video data may be stereoscopic videodata.

FIG. 8 is a flowchart illustrating a method for controlling a digitalbroadcast transmitter and a digital broadcast receiver for providing a3DTV service when a digital broadcast transmitter transmits a cameraparameter according to an embodiment of the present invention. A methodfor allowing a digital broadcast transmitter to transmit a video signalincluding a camera parameter and a method for allowing a digitalbroadcast receiver to generate and restore video data (or image data) onthe basis of the camera parameter will hereinafter be described withreference to FIG. 8.

The digital broadcast transmitter captures video data using severalcameras (e.g., a pair of stereoscopic cameras), and acquires multiplevideo information at step S810. At least one of several cameras may be areal camera, and each of the remaining cameras may be a virtual camera.In this case, the real camera may be a camera that transmits a stream ofa captured image to a digital broadcast receiver. The virtual camerameans a camera that transmits a camera parameter to the digitalbroadcast receiver, such that a video stream is not transmitted to thedigital broadcast receiver and the digital broadcast receiver canrestore the corresponding stream. The above-mentioned virtual camera maynot be actually present, but the following camera parameter for thevirtual camera may be optionally decided by a broadcast program produceror engineer.

In correspondence with each of real cameras, a camera (called a depthcamera) for obtaining depth information (or range information)associated with each primary viewpoint contained in an image is arrangedso that a digital broadcast receiver can simultaneously obtain the image(or video information) and the depth information. Moreover, the digitalbroadcast transmitter may extract additional information to betransmitted to the digital broadcast receiver from the image captured bythe camera. The additional information may include specific informationto estimate a blind part covered by a front object. For example, thespecific information may include geometrical information such as anobject outline, object transparency information, color information, etc.In accordance with the embodiment of the present invention, theadditional information may be acquired from the real camera. However, inaccordance with any modified embodiment, the additional information maybe acquired from either an image captured by the virtual camera or acombination of an image captured by the real camera and an imagecaptured by the virtual camera. Depth information and/or additionalinformation may not be always needed, and the depth and/or additionalinformation may be optionally extracted and transmitted when the digitalbroadcast receiver generates a virtual image.

At step S820, the digital broadcast transmitter formats not only a 2Dvideo stream but also signaling information of at least one stream forthe 3DTV service using multiple video information captured by thecamera. In other words, the digital broadcast transmitter may multiplexa video signal in the form of the above image and a combination of depthinformation and additional information.

The digital broadcast transmitter encodes the formatted 2D video stream,signaling information of at least one stream for the 3DTV service, and acamera parameter at step S830. The digital broadcast transmittertransmits the encoded 2D video stream, the signaling information of atleast one stream for the 3DTV service, and the camera parameter at stepS840.

However, although Steps S820, S830 and S840 have been illustrated inFIG. 8 to process the 2D video stream, the signaling information, thecamera parameter, etc., it can be that a depth stream, an occlusionstream, and a transparency stream corresponding to the signalinginformation may be additionally processed so that the processed resultmay be transmitted to the digital broadcast receiver.

If the digital broadcast receiver receives a 2D video stream, signalinginformation, and the camera parameter at step S850, the digitalbroadcast receiver recovers an image according to the 2D video streamand the signaling information. In accordance with another embodiment ofthe present invention, the depth stream, the occlusion stream, and thetransparency stream corresponding to the signaling information may beadditionally received at the digital broadcast receiver.

First, the digital broadcast receiver performs 3D warping using thecamera parameter, and restores depth information at the location of thevirtual camera at step S860. Subsequently, the digital broadcastreceiver may synthesize and restore the image acquired at the virtualcamera location according to the 3D format at step S870. The digitalbroadcast receiver outputs 3D video data at step S880. The 3D video datamay be stereoscopic video data or the like.

FIG. 9 is a conceptual diagram illustrating some parts of the digitalbroadcast transmitter operations shown in FIG. 8 according to anembodiment of the present invention. FIG. 10 is a conceptual diagramillustrating some parts of the digital broadcast receiver operationsshown in FIG. 8 according to an embodiment of the present invention.

Referring to FIGS. 9 and 10, the digital broadcast transmitter maytransmit the encoded video information, the encoded depth information,and the encoded additional information, and the digital broadcastreceiver may decode the video information, the depth information, andthe additional information, such that an objective image can begenerated and restored, and as such a detailed description thereof willhereinafter be described in detail.

As can be seen from FIG. 9, for convenience of descriptor and betterunderstanding of the present invention, one real camera and one virtualcamera are shown in FIG. 9. However, the number of real cameras and thenumber of virtual cameras are disclosed only for illustrative purposes,and it is apparent to those skilled in the art that more real camerasand more virtual cameras may also be installed as necessary.

In FIG. 9, it is assumed that an image captured by the real camera is‘img[0]’ and an image captured or capturable by the virtual camera is‘img[1]’. It is assumed that a point corresponding to the point P in a3D real world on the image img[0] is denoted by p[0], and a pointcorresponding to the point P on the image img[1] is denoted by p[1]. Thecamera parameter may be classified into an intrinsic camera parameterand an extrinsic camera parameter. The intrinsic camera parameter mayindicate optical characteristics of a camera lens, such as a focallength and a principal point, and unique characteristics of a camera,such as a skew factor. The extrinsic camera parameter may indicategeometrical-location and direction of the real camera or the virtualcamera, and may include a translation and the amount of rotation, etc.of each reference coordinate system with respect to a referencecoordinate system of the real world. In the example of FIG. 9, it isassumed that the intrinsic camera parameter of a first camera (i.e., thereal camera) is denoted by ‘A’. If it is assumed that a second camera(i.e., the virtual camera) is the same kind as the first camera and issufficiently calibrated with the first camera, the intrinsic cameraparameter of the second camera is also set to ‘A’ in the same manner asin the first camera. It is assumed that the amount of rotation of thefirst camera is denoted by r[0] and the translation of the first camerais denoted by t[0]. The amount of rotation of the second camera isdenoted by r[1] and the translation of the second camera is denoted byt[1].

In accordance with the embodiment of the present invention, depthinformation and image information are transmitted to the digitalbroadcast receiver of each of all real cameras. In addition, theadditional information is configured on the basis of one image, and isthen transmitted to the digital broadcast receiver. Therefore, in theexample of FIG. 9 including one real camera and one virtual camera, theimage img[0] and depth information depth[0] of the first camera actingas the real camera are transmitted to the digital broadcast receiver. Inaddition, the additional information is further transmitted to thedigital broadcast receiver so that the image img[1] and the depthinformation depth[1] of the second camera can be used in the digitalbroadcast receiver.

The digital broadcast receiver decodes the encoded video signal, andrestores the image img[0], the depth information depth[0], and theadditional information for the first camera acting as the real camera.In addition, the digital broadcast receiver restores camera parametersA, r[0], t[0], r[1], and t[1] for all cameras during the decodingprocess. Referring to FIG. 10, the digital broadcast receiver generatesdepth information ‘depth[1]’ at the location of the second camera usingthe camera parameters A, r[0], t[0], r[1], and t[1], the image img[0]and the depth information ‘depth[0]’ of the first camera, and theadditional information. Subsequently, the digital broadcast receiverperforms 3D warping so that the image img[1] of the location of thesecond virtual camera is generated. In this way, the image img[0]captured by the first camera and the image img[1] captured by the secondcamera are obtained, so that the digital broadcast receiver formats twoimages (i.e., the real image img[0] and the virtual image img[1]) so asto display the 3D image. For example, one of the real image and thevirtual image is set to a left view image and the other one is set to aright view image, so that these images are stereoscopically displayedaccording to a 3D format.

In order to implement the 3DTV service, the additional viewpoint imagemust be obtained. Specifically, as shown in FIG. 8, a method forobtaining the additional viewpoint image while the camera parameter istransmitted will hereinafter be described.

One point (i.e., the point P) of a 3D space is mapped to p[0] in the0-th camera, and is mapped to p[1] in the first camera. The relationshipamong p[i], s[i], A[i], r[i], and t[i] can be represented by thefollowing equation 1 using the camera parameter transferred from thedigital broadcast transmitter.

$\begin{matrix}{{{s\lbrack i\rbrack}\left\lbrack \frac{p\lbrack i\rbrack}{1} \right\rbrack} = {{{A\lbrack i\rbrack}\begin{bmatrix}{r\lbrack i\rbrack} & {t\lbrack i\rbrack}\end{bmatrix}}\left\lbrack \frac{P}{1} \right\rbrack}} & \left\lbrack {{Equation}\mspace{14mu} 1} \right\rbrack\end{matrix}$

In Equation 1, s[i] is a scaling factor at the i-th camera, A[i] is anintrinsic parameter of the i-th camera, r[i] is a rotation value amongextrinsic cameras of the i-th camera, and t[i] is a translation valueamong extrinsic parameters of the i-th camera.

With respect to the point mapped to the i-th camera, the equation forthe point mapped to the 0-th camera can also be represented by thefollowing equation 2.

z[i]p[i]=z[0]A[i]r[i]r[0]A[0]⁻¹ p[0]−A[i]r[i]r[0]⁻¹t[0]+A[i]t[i]  [Equation 2]

In Equation 2, z is a depth value.

If the 3D warping, such as homographic transform, is performed on acorresponding depth map by means of the parameter of the 0-th camerahaving acquired 2D video data, the depth map of the i-th virtual cameracan be obtained. Therefore, the depth value of Equation 2 can beobtained so that the image value p[i] mapped to the i-th camera can becalculated.

Equation 1 and Equation 2 can be represented by the following equations(a) and (b).

s[i]p[i]=A[i]r[i]P+A[i]t[i]  [Equation (a)]

s[0]p[0]=A[0]r[0]P+A[0]t[0]  [Equation (b)]

Equation [b] can be represented by the following equation (c).

A[0]r[0]P=s[0]p[0]−A[0]t[0]  [Equation (c)]

P=s[0]r[0]⁻¹ A[0]⁻¹ p[0]−r[0]⁻¹ t[0]

If Equation (c) is substituted into Equation (a), the following equation(d) can be obtained.

s[i]p[i]=s[0]A[i]r[i]r[0]⁻¹ A[0]⁻¹ p[0]−A[i]r[i]r[0]⁻¹t[0]+A[i]t[i]  [Equation (d)]

In Equation (d), if s(i) is replaced with depth, ‘z[i]’, and p[i]⁻¹ ismultiplied by each of both sides, the following equation (e) can beacquired.

s[i]=s[0]A[i]r[i]r[0]⁻¹ A[0]⁻¹ p[0]p[i] ⁻¹ −A[i]r[i]r[0]⁻¹ t[0]p[i] ⁻¹+A[i]t[i]p[i] ⁻¹  [Equation (e)]

For example, the depth map is a depth image composed of 3D coordinatesof each pixel corresponding to one 2D picture. Therefore, eachcoordinate values of the depth map corresponds to a depth value of theposition (x,y) corresponding to the 2D picture. In other words, thedepth value can mean a distance from a camera to an object.

In accordance with the application of the above-mentioned method, if thedigital broadcast receiver establishes a predetermined virtual camera,i.e., if the digital broadcast receiver establishes a camera parameter,3D video data (or 3D image) of a new viewpoint can be implemented.

FIG. 11 shows one case having no occlusion data and the other casehaving occlusion data in a process for implementing a screen image of a3DTV service according to one embodiment of the present invention.

As described above, when a new viewpoint image is obtained so as toconvert a 2D video signal into a 3D video signal using the depthinformation, a newly viewed part (i.e., the occlusion area) of the newviewpoint must be hole-filling processed with peripheral values (e.g.,pixel values) in a subsequent process. For example, as shown in theupper part of FIG. 11, the hole-filling process may also be applied evento the case having no occlusion data.

However, in the case of transmitting the occlusion information over atransmission channel, a more perfect 3D image can be implemented even atthe new viewpoint as shown in the lower part of FIG. 11. In addition,when transmitting transparency information over the transmissionchannel, a boundary between a background view and a panoramic view canalso be more smoothly processed.

FIG. 12 is a flowchart illustrating a method for controlling a digitalbroadcast transmitter and a digital broadcast receiver for providing a3DTV service when the digital broadcast transmitter transmits no cameraparameter according to an embodiment of the present invention. A methodfor enabling a digital broadcast receiver to generate and restore animage on the condition that the digital broadcast transmitter transmitsa video signal having no camera parameter will hereinafter be describedwith reference to FIG. 12.

Referring to FIG. 12, the digital broadcast transmitter controls severalcameras (e.g., a pair of stereoscopic cameras) to capture an image, sothat it obtains multiple video information at step S1210. At least oneof several cameras is a real camera and each of the remaining cameras isa virtual camera. However, the process shown in FIG. 12 may also beinterpreted by referring to the method shown in FIG. 8.

At step S1220, the digital broadcast transmitter formats not only a 2Dvideo stream but also signaling information of at least one stream forthe 3DTV service using multiple video information captured by thecameras.

The digital broadcast transmitter encodes the formatted 2D video stream,signaling information of at least one stream for the 3DTV service, and acamera parameter at step S1230. The digital broadcast transmittertransmits the encoded 2D video stream and the signaling information ofat least one stream for the 3DTV service at step S1240.

However, although Steps S1220, S1230 and S1240 have been illustrated inFIG. 12 to process the 2D video stream, the signaling information, etc.,it can be that a depth stream, an occlusion stream, and a transparencystream corresponding to the signaling information may be additionallyprocessed so that the processed result may be transmitted to the digitalbroadcast receiver.

If the digital broadcast receiver receives a 2D video stream andsignaling information at step S1250, the digital broadcast receiver mayrecover an image according to the 2D video stream and the signalinginformation. In accordance with another embodiment of the presentinvention, the depth stream, the occlusion stream, and the transparencystream corresponding to the signaling information may also beadditionally received at the digital broadcast receiver.

First, the digital broadcast receiver may synthesize and restore a newviewpoint image using the assumption of viewing geometry at step S1260,and a detailed description thereof will hereinafter be described withreference to FIG. 15. Furthermore, the digital broadcast receiveroutputs 3D video data at step S1270. The 3D video data may bestereoscopic video data or the like.

FIG. 13 is a conceptual diagram illustrating some operations of thedigital broadcast transmitter shown in FIG. 12 according to anembodiment of the present invention. FIG. 14 is a conceptual diagramillustrating some operations of the digital broadcast receiver shown inFIG. 12 according to an embodiment of the present invention.

Referring to FIG. 13, if camera parameters (e.g., A, r, t, etc.) are nottransmitted in a different way from FIG. 9, it is impossible tocalculate a new viewpoint for synthesizing the 3D image using suchcamera parameters as shown in FIG. 10. In this case, as shown in FIG. 14or 15, it is necessary to calculate the new viewpoint using theassumption of view geometry.

FIG. 15 is a conceptual diagram illustrating a method for acquiring anadditional viewpoint image needed for the 3DTV service using theassumption of viewing geometry when the digital broadcast transmittertransmits no camera parameter. In FIG. 15, B is a distance between rightand left eyes, and D is a distance between a display panel and the humanbeing. If a predetermined average value is substituted into each of thedistance values, the disparity (p) can be calculated using the principleof trigonometry as shown in FIG. 15. The distance (z) indicating thedistance from a new viewpoint to the display panel so as to implementthe 3D image can be calculated using the depth map.

Therefore, in association with each pixel of the 2D video data, thedistance (z) can be calculated on the basis of the depth valuecorresponding to each pixel of the depth map. In addition, the disparity(p) may be calculated by the following equation 3, and the pixelposition can be shifted by the disparity (p). If the above-mentionedprocesses are carried out on all pixels of 2D video data, a new 3Dsynthesized image can be implemented.

$\begin{matrix}{\frac{z}{p} = {\left. \frac{z + D}{B}\Rightarrow p \right. = \frac{B\; z}{z + D}}} & \left\lbrack {{Equation}\mspace{14mu} 3} \right\rbrack\end{matrix}$

As described above, when a new viewpoint image is obtained so as toconvert a 2D video signal into a 3D video signal using the depthinformation, a newly viewed part (i.e., the occlusion area) of the newviewpoint must be hole-filling processed with peripheral values (e.g.,pixel values) in a subsequent process.

However, in the case of transmitting the occlusion information over atransmission channel, a more perfect 3D image can be implemented even atthe new viewpoint as shown in the lower part of FIG. 11. In addition,when transmitting transparency information over the transmissionchannel, a boundary between a background view and a panoramic view canalso be more smoothly processed.

As described above, in accordance with one embodiment of the presentinvention, a process for transmitting signaling information for the 3DTVservice, a process for receiving the signaling information, and aprocess for processing the signaling information are definitely defined,so that a conventional DTV can provide not only the 2D broadcast servicebut also the 3DTV service.

Moreover, in accordance with another embodiment of the presentinvention, although the signaling information and the camera parameterare transmitted or not transmitted, the 3DTV service can be implemented.

The method disclosed in the present invention may be implemented in theform of program commands executable by a variety of computer means, andrecorded on a computer-readable recording medium. The computer-readablerecording medium may include program commands, data files, datastructures, etc. individually or in combination. The program commandsrecorded on the medium may be ones specially designed and configured forthe present invention or ones known and available to those skilled incomputer software. Examples of the computer-readable recording mediuminclude magnetic media such as a hard disk, a floppy disk and a magnetictape, optical media such as a compact disc read only memory (CD-ROM) anda digital versatile disc (DVD), magneto-optical media such as afloptical disk, and hardware devices specially configured to store andexecute program commands, such as a ROM, a random access memory (RAM)and a flash memory. Examples of the program commands include high-levellanguage codes that may be executed by a computer using an interpreter,etc., as well as machine language codes such as those produced by acompiler. The above-stated hardware devices may be configured to operateas one or more software modules to perform the operation of the presentinvention, and vice versa. Although the present invention has beendescribed in conjunction with the limited embodiments and drawings, thepresent invention is not limited thereto. Those skilled in the art willappreciate that various modifications, additions and substitutions arepossible from this description. Therefore, the scope of the presentinvention should not be limited to the description of the exemplaryembodiments and should be determined by the appended claims and theirequivalents.

MODE FOR INVENTION

Various embodiments have been described in the best mode for carryingout the invention.

INDUSTRIAL APPLICABILITY

As apparent from the above description, embodiments of the presentinvention may be wholly or partially applied to a digital broadcastingsystem.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the invention. Thus, it isintended that the present invention cover the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

1. A method for receiving a three dimensional (3D) broadcast signal, themethod comprising: receiving signaling information of at least onestream for a 3 Dimension TeleVision (3DTV) service and a two dimensional(2D) video stream; demultiplexing at least one stream for the 3DTVservice and the 2D video stream based on the signaling information;decoding at least one demultiplexed stream for the 3DTV service and thedemultiplexed 2D video stream; and outputting a 3D video signal byformatting at least one decoded stream for the 3DTV service and thedecoded 2D video stream.
 2. The method according to claim 1, wherein thesignaling information is defined in a descriptor of a Virtual ChannelTable (VCT) or a Program map Table (PMT).
 3. The method according toclaim 2, wherein the signaling information includes: a first field foridentifying at least one of depth information, occlusion information,and transparency information corresponding to the 2D video stream; and asecond field for identifying a coding type of the depth information, theocclusion information, or the transparency information.
 4. The methodaccording to claim 3, wherein the signaling information further includesa third field that identifies whether resolution of at least one streamfor the 3DTV service is identical to that of the 2D video stream.
 5. Amethod for transmitting a three dimensional (3D) broadcast signal, themethod comprising: acquiring multiple video information captured by atleast two cameras; formatting a two dimensional (2D) video streamextracted from the acquired multiple video information and signalinginformation of at least one stream for a 3 Dimension TeleVision (3DTV)service; encoding the formatted 2D video stream and the formattedsignaling information of at least one stream for the 3DTV service; andtransmitting the encoded 2D video stream and the encoded signalinginformation of at least one stream for the 3DTV service.
 6. The methodaccording to claim 5, wherein the encoding of the formatted 2D videostream and the formatted signaling information of at least one streamfor the 3DTV service further includes: encoding the formatted 2D videostream, the formatted signaling information of at least one stream forthe 3DTV service, and a camera parameter.
 7. The method according toclaim 6, wherein the transmitting of the encoded 2D video stream and theencoded signaling information of at least one stream for the 3DTVservice further includes: transmitting the encoded 2D video stream, theencoded signaling information of at least one stream for the 3DTVservice, and a camera parameter.
 8. The method according to claim 5,wherein the at least one stream for the 3DTV service corresponds to astream including depth information corresponding to the 2D video stream,a stream including occlusion information, or a stream includingtransparency information.
 9. A digital broadcast receiver for processinga three dimensional (3D) broadcast signal, the digital broadcastreceiver comprising: a tuner for receiving signaling information of atleast one stream for a 3 Dimension TeleVision (3DTV) service and a twodimensional (2D) video stream; a demultiplexer for demultiplexing atleast one stream for the 3DTV service and the 2D video stream based onthe signaling information; a decoder for decoding at least onedemultiplexed stream for the 3DTV service and the demultiplexed 2D videostream; and a formatter for outputting a 3D video signal by formattingat least one decoded stream for the 3DTV service and the decoded 2Dvideo stream.
 10. The digital broadcast receiver according to claim 9,wherein the signaling information includes: a first field foridentifying at least one of depth information, occlusion information,and transparency information corresponding to the 2D video stream; and asecond field for identifying a coding type of the depth information, theocclusion information, or the transparency information.
 11. A digitalbroadcast transmitter for processing a three dimensional television(3DTV) broadcast signal, the digital broadcast transmitter comprising: adetector for acquiring multiple video information captured by at leasttwo cameras; a formatter for formatting a two dimensional (2D) videostream extracted from the acquired multiple video information andsignaling information of at least one stream for a 3 DimensionTeleVision (3DTV) service; an encoder for encoding the formatted 2Dvideo stream and the formatted signaling information of at least onestream for the 3DTV service; and a transmitter for transmitting theencoded 2D video stream and the encoded signaling information of atleast one stream for the 3DTV service.
 12. The digital broadcasttransmitter according to claim 11, wherein the encoder encodes encodingthe formatted 2D video stream, the formatted signaling information of atleast one stream for the 3DTV service, and a camera parameter.